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ABSTRACT 



A stochastic analysis of the Supply Corps officer 
manpower system is presented. The analysis is based on the 
concept of diffusion approximations. The state of a rank 
is represented as the superposition of a deterministic process, 
and a random noise variable, both of which are derived 
utilizing a set of formulated recursion equations. Numeri- 
cal results are presented for a 3-rank system and compared 
against a simulation of a Markovian manpower model. 

A Diffusion Approximation analysis is performed utilizing 
United States Navy Supply Corps data, in an effort to 
determine the probability of maintaining each rank, any 
two ranks, and/or the entire system between specified limits. 
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I . 



INTRODUCTION 



This paper attempts to examine manpower problems uti- 
lizing stochastic techniques. The point of departure is the 

/ 

deterministic theory of control given in Bartholomew [Ref. 1] , 
and the object is to see how concepts and strategies origi- 
nating in that context perform in a stochastic environment 
of the kind likely to be encountered in practice. Conclusions 
reached, both in this thesis and in Bartholomew [Ref. 3] , 
suggest that, although useful, deterministic analysis is 
incomplete since it fails, for example, to provide required 
information concerning the variance of individual ranks. 
Without such information, manpower planners may attempt to 
"fine tune" the system by increasing or decreasing promotion 
or recruitment rates when in reality the fluctuations are 
due to the uncertainty in the system. 

This study concentrates its efforts on one particular 
manpower system — that being the Supply Corps of the United 
States Navy. An effort is made to develop a stochastic model 
that provides the capability for simple computation. In 
addition, it will give the mean number of individuals in 
each rank, as do deterministic models; and as added features, 
will provide second order moments and distribution of force 
information. Armed with these key elements we can then 
attempt to answer questions related to the maintenance of 
desired force structures and with the ability to attain such 
structures . 
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The numbers of people in particular ranks change over 
time as a result of attrition, promotion and recruitment. 

Some of these flows are subject to management control while 
others vary due to a multitude of circumstances and may best 
be modelled stochastically. Factors such as the need to offer 
adequate career prospects, while at the same time, maintain- 
ing prescribed force levels are the manpower planners chief 
goals. A problem arises in that the planner must determine 
whether these goals can be achieved simultaneously, and, if 
so, how best to achieve them. 

The manpower control problem has received a good deal of 
attention in recent years — see, for example, Bartholomew 
[Refs. 1,2,3], Davies [Refs. 4,5] and Grinold and Stanford 
[Ref. 6]. 

Although most of the work on manpower control has been 
based on stochastic models, the analysis has been determinis- 
tic in the sense that only expected values for attrition and 
promotion rates are used. More realistically, attrition and 
other flows do vary randomly and are therefore better repre- 
sented by random variables. Recent work which does attempt 
to incorporate randomness into manpower control are Bartholomew 
[Refs. 2,3] and Kim [Ref. 7]. 

In this thesis we will assume that only promotion rates 
and recruitment rates are subject to control. While it may 
be true that attrition can be dramatically increased, uti- 
lizing techniques such as "Reductions in Force", it is the 
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problem of being unable to hold down attrition rates that 
plagues the present day Navy. As a result, the model developed 
in this thesis utilizes, as an input parameter, the attrition 
rate and is capable of determining, in a deterministic sense, 
the promotion and recruitment rates required to maintain the 
system at some specified level. Henceforth, the concept of 
being able to maintain a specified force structure will be 
referred to as maintainability; i.e., a structure is main- 
tainable if and only if there are promotion and recruitment 
rates such that for each rank in the system, the expected 
number of individuals who depart during each time period is 
equal to the expected number of individuals who arrive during 
that same time period. The majority of this thesis will deal 
with the maintainability of desired force structures, but it 
turns out that this topic cannot be treated adequately with- 
out considering the question of whether those structures can 
be attained from present levels. 

Since for all practical purposes, recruitment into the 
Supply Corps takes place only into the lowest rank, promotion 
control alone is left as a means of controlling the force 
distribution. Control by promotion has the disadvantage that 
fluctuations in the promotion rate are liable to create 
internal stresses within the organization. On the other 
hand, it was shown in Bartholomew [Ref. 1, Chapter 4], that 
in a deterministic environment, promotion control is capable 
of maintaining a much wider range of structures than recruit- 
ment control alone. 
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Having discussed the various areas of consideration, the 
general scope of this paper will be to present the following: 

A. A basic deterministic Markovian model will be 
derived in Chapter II, to be used as a benchmark with which 
to compare the stochastic version. 

B. Realizing that a deterministic representation is not 
representative of the random factors that affect most pro- 
cesses, a more realistic stochastic model will be derived 

in Chapters III and IV utilizing a Diffusion Approximation. 

C. Results of a simulation of a stochastic Markovian 
manpower model will be presented in Chapter V and compared 
to results of the Diffusion Approximation as developed in 
this thesis. Shortfalls of the approximation will be dis- 
cussed and advantages of the approximation pointed out. 

D. A comparison of the deterministic and stochastic 
models will be made in Chapter VI. In particular, the corre- 
lation between adjacent ranks, and its effect on the ability 
to maintain desired force structures will be discussed. 

E. Areas of possible further study will be briefly 
mentioned in Chapter VI. An effort is made to identify 
possible research topics, whose results, when used in conjunc- 
tion with the model derived in this thesis, may reflect to 

an even greater degree the stochastic nature of a manpower 
system. 
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II. DETERMINISTIC ANALYSIS 



A. A DETERMINISTIC MANPOWER MODEL FOR THE SUPPLY CORPS 

Before one attempts to model any system, one must be 
familiar with its everyday operations. In an effort to 
compare the results of the approximation against a benchmark, 
we will use our familiarity of the system to make several 
educated assumptions as to the values of promotion and attri- 
tion rates within the supply Corps. A compilation of these 
educated guesses, will define a Markovian transition matrix; 
the elements of which are the fractions of individuals in 
each rank that stay in the rank or are promoted in each time 
period. This matrix will then be compared against one where 
historical data is used as a basis for determining the ele- 
ments of the Markovian transition matrix. Comparison between 
the two will answer the question of whether organizational 
assumptions made are reasonable. 

The organizational assumptions that we will make are as 
follows : 

1. We will assume that the fraction of Supply Corps 
officers with a particular number of years in a specified 
rank remains almost constant; that is, we will assume that 
the fraction of the supply Corps force that are second year 
Lieutenants or third year Lieutenant Commanders, etc., 
remains the same. 

2. Under present promotion patterns, promotion from 
Ensign (q- 1) to Lieutenant Junior Grade (0-2) occurs at the 
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2 year point in an officer's career. In addition, promotion, 
for all practical purposes, is assured for all Ensigns com- 
pleting their second year. It is therefore assumed in light 
of assumption 1, that approximately 50% of all 0-1 's are 
completing their second year and will therefore be promoted 
to 0-2. 

3. Similarly, it takes two years to transition between 
ranks 0-2 and Lieutenant Commander (0-3) ; however, only 95% 
of those in the second year in rank 0-2 get promoted. There- 
fore, this implies that 50% of all 0-2 's are in the promotion 
zone, and 95% of those eligible are promoted. This informa- 
tion yields the promotion fraction equal to 0.475 (0.50 x 0.95). 

4 . Using similar logic the following table values are 
computed : 

Years Required Assumed per- Assumed Promotion 
in grade prior centage of promotion fraction of 

to being in total grade rate for all members 





zone 


in zone 


in zone 


in grade 


Ensign (0-1) 


2 


0.5000 


1.0000 


0.5000 


Lieutenant 
Junior Grade 
(0-2) 


2 


0.5000 


0.9500 


0.4750 


Lieutenant 

(0-3) 


5 


0.2000 


0.9000 


0.1800 


Lieutenant 

Canmander 

(04) 


7 


0.1429 


0.8000 


0.1143 


Corrmander 

(05) 


5 


0.2000 


0.6000 


0.1200 
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In order to complete the transition matrix, it is necessary 
to determine reasonable attrition rates. Attrition rate data 
was obtained from historical data files at the Naval Military 
Personnel Command. Attrition rates cannot be forecasted with 
great accuracy, due in great measure to their correlation to 
many economic and social factors. Thus it appears reasonable 
to use a simple moving average as a predictor. We will use 

V i (t-1) + v i (t) 

2 

as a forecasted value for the current attrition rate for 
stage i at time t+1. 

This average appears to be a better forecasting technique 
than that of simply using the last attrition rate. A reason 
for not considering more terms in the attrition forecast, 
is the fact that we want the forecasted attrition rate to 
reflect only the recent past and not to consider forces which 
may have affected the manpower system at one time but are no 
longer present. 

The remaining element required in the transition matrix 
is the continuation rate. Since the sum of the continuation 
rate, the attrition rate and the promotion rate must equal 
one, it is a simple matter to compute the remaining elements 
of the transition matrix. It should be mentioned once again, 
that these assumptions are not related to any historical 
data, except for attrition rates and existing "in zone" 
promotion rates. The resulting matrix is computed merely to 
compare against the matrix derived in the next subsection. 



12 
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B. PROMOTION RATES REQUIRED TO MAINTAIN THE SUPPLY CORPS 

AUTHORIZED FORCE SIZE 

The objective of this subsection, is to find out if the 
force levels which the supply Corps has been authorized, 
are in fact maintainable. The authorized force levels men- 
tioned are included in Appendix A, and are obtained from the 
Officer Programmed Authorizations, Fiscal Years 1979-1983 
[Ref. 9]. In an effort to work with a single force level, 
the average force level was computed for the five years men- 
tioned above; and it is this level that we attempt to maintain. 
It should be noted that over the 5 years under consideration, 
neither the individual ranks nor total force strength vary 
significantly, so the average force appears to be a reasonable 
force level to maintain. 

If we determine that the desired force can be maintained, 
we will then have a transition matrix which can be compared 
against the matrix P^ derived in subsection II. A. This will 
give us an idea of how drastically the system would have to 
change in order to maintain the desired force levels. 

Before we proceed, a few definitions for the above: 

Q = a six component row vector whose elements 
are the number in each rank. 



P 5 a 6 x 6 matrix whose elements contain promo- 
tion and continuation rates. (See matrix 
P., subsection II. A for the general form 
or this matrix.) 

T 

V = a column vector whose elements contain the 
appropriate attrition rates for each rank. 
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R £ the recruitment vector, which directs the 
flow of recruits into the proper ranks 
(fraction of recruits for each rank) . 

In the Supply Corps, the recruitment vector is not gen- 
erally amenable to control, i.e., recruitment for the most 
part occurs into the lowest rank, i.e., R= [1,0, 0,0, 0,0]. 

In such cases we wish to know what degree of control can be 
exercised by the promotion rates. For a fixed size organiza- 
tion, what we wish to do is to find a transition matrix P, 
which allows us to maintain our desired structure Q. This 
implies that P must satisfy 

Q = QP + QV T R (II.B.l) 

T 

where Q V R yields the number of recruits necessary to 
exactly equal the number of attritions at each time period. 

As was noted in subsection II. A, the matrix P is super- 
diagonal in form, i.e., non-zero elements only in the main 
diagonal and the diagonal above it. Bartholomew [Ref. 1] 
shows that when P has the super-diagonal form, equation (II .B . 1) 
admits a unique solution which may be tested to see whether its 
elements are non-negative. If the matrix P is found to be 
non-negative, then the structure Q can be maintained. 

As was mentioned previously, while we assume that 
recruitment takes place only into the lowest rank, we recog- 
nize the fact some recruitment does occur in ranks 0-2 and 
0-3. However, the number recruited into these ranks is small 
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and hence will be neglected. Also, the attrition rates 
are as considered previously, i.e., 

V = [0.0272,0.1355,0.1121,0.0390,0.0790,0.1622]. 

We note that equation (II.B.l) is equivalent to 

QP = Q-QV T R 

and, at this point it becomes more convenient to abandon 
the matrix notation temporarily and to proceed with the com- 
ponents as does Bartholomew [Ref. 1] : 

°i p n - Q i - R i i, c i v i 

i=l 

k 

Q 1 P 12 + Q 2 P 22 = Q 2 " R 2 .J^^i 

k 

Q.P C , + Q,P^ C = Q, - R* y Q.V. . 

4 56 4* 66 6 6 , L . l l 

1=1 

(The above are components of the respective vectors or 
matrices mentioned at the beginning of this subsection.) 

Eliminating using P^ = 1 - - P^ (i = 1,2,..., 

k-1) and using our special structure for the vector R yields 
the following equation: 
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(II. B. 2) 



i , i+1 



k 

I 

j-i+1 



Q -V ./Q. 
D J 1 



In other words, equation (II.B.2) says that the proportions 
required to be promoted from grade i must equal the number 
leaving from all grades above grade i divided by the size 
of grade i. 

For example, given a point estimate for the attrition 
rate, and given that the promotion rates for 0-6 's is essen- 
tially zero; it is possible to compute the number of 0-6 's 
who depart the system. Given this value, one can then 
compute the number of 0-5' s who must be promoted each year 
to exactly maintain the required level of 0-6' s. The process 
continues in this fashion until we compute the required num- 
ber of new accessions required to maintain the 0-1 Rank. It 
is in this way that promotion rates can be calculated to 
exactly maintain the desired structure (assuming that we are 
at the structure we wish to maintain) . If we are at some 
other force level and we wish to attain our goal, similar 
calculations can be done, but review must be done to ensure 
that the resulting promotion rates are within acceptable 
bounds as specified by organization policy. 

For example, suppose we wish to maintain the following 
structure : 
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Total Force 


Rank 


Strength 


0-1 


621 


0-2 


625 


0-3 


995 


0-4 


863 


0-5 


617 


0-6 


234 



Level = 3955 

Attrition Rates 
0.0272 
0.1355 
0.1121 
0.0390 
0.0790 
0.1622 



We first compute the number of 0-6 's lost. This is equal to 
(234) (0.1622) = 37. 9548. To maintain the desired structure 
37.9548 0-5' s on the average must be promoted. Therefore, 
the promotion rate required is (37.9548) -j- (617) = 0.0615. 

An important note to make, is that promotion rate is used 
in relation to the total rank strength, to determine what 
the rate would be in regards to "In the promotion zone" 
strength, one must first determine the number to be promoted, 
and then divide that number by the number "in the zone". In 
our example, promotion rate related to "In the zone" would be 
37.9548 -f- (number of O-5's in zone). The other promotion 
rates can be similarly computed, and as a final result we 
obtain the matrix P 2 * 

Comparing this matrix with P.^ reveals that the reasonable 
guesses for the existing system are very close, in most cases, 
to the rates necessary for maintaining the desired system on 
the average. This implies that very little has to be done in 
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way of changing promotion rates if we simply want to get 
to and maintain the desired levels. It should be stressed, 
that once a specified force level has been shown to be 
maintainable, it can be attained from any starting force 
level as was stated in Ref. 1. In the Supply Corps, present 
rank levels are not equal to desired rank levels. However, 
if promotion rates were modified to those suggested by 
we would eventually reach a system of manpower stocks whose 
expected value in each rank would equal the desired levels. 

A technique that suggests a method to speed up the process 
of convergence from present levels to desired levels will be 
discussed in a later chapter. 



20 



III. THE DIFFUSION MODEL 



The system we wish to model is as depicted below: 





The variables of interest are as follows: 



Q 0 


E 


the force available for recruitment. 






assumed to be large. 


a (t) 


= 


the accession rate at time t 


u i (t) 


= 


the promotion rate for all members in 
rank i at time t 


v i (t) 


= 


the attrition rate for all members in 
rank i at time t 


Q L (t) 


= 


the Random Variable which is the force 
level in rank i at time t. 



Other variables of interest to be incorporated into the 
model are: 

q.(t) = the expected fraction of the total force 

1 in rank i at time t (computed as fraction 

of original total force level) 



E[Q i (t) ] 
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Promotion random noise variable 
distributed N(0,1) (when i = 0, 
W P(t) relates to accession) 



o 




Loss random noise variable, distributed 

11 ( 0 , 1 ) 




standardized random noise variable 



The probability that a member of rank i gets promoted 
at time t is equal to u^(t); this implies that the proba- 
bility that the member does not get promoted is equal to 
l-u^(t). We will assume that whether or not an individual 
is promoted is independent of others in the system at time 
t. Thus, the number promoted will have a binomial distribution 
with expected value u^(t)Q^(t) and a variance of 
u i (t) [1 - (t) ]Q i (t) . 

Using similar reasoning the number of attritions in rank 
i at time t is assumed to have a binomial distribution with 
an expected value of v^(t)Q^(t) and a variance of 
v i (t) [1 - v i (t) ]Q i (t) . 

In rank 1 we have a special case, since we must consider 

the accession rate as a function of the total force level. 

We will assume that there is a large population of potential 

recruits of size Q . We assume the number of people that 

enter the system at time t has a binomial distribution with 

mean a(t)Q and a variance of a(t) [l-a(t)]Q . In what 
o o 

follows we will usually take Q to be the initial force 

o 

strength. 
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If one deals with a system which is sufficiently large, 
one can invoke the Central Limit Theorem. Therefore if Q q 
is "large", this would imply that Q^(t) is "large" and 
therefore the distribution of number promoted can be approxi 
mated by a Normal Distribution with mean u^(t)Q^(t) and a 
variance of u^(t) [1 - u^ (t) ] ( t) . Similar results apply to 
the number of attritions in each rank. 

Now, recall if X is distributed normal with mean y and 
2 2 

variance a [X ~ N(y,a )]. Then 

aX + b - N (ay + b,a^a^) . 



Let 



W i P (t) - N ( 0 , 1 ) , 



then 



Q i (t)u i (t) + /Q i (tTu.(t) [1 - u i (t) ] W i P (t) 

- N(Q i (t)u i (t) ,Q i (t)u i (t) [1 - u i (t) ]) 

which is a normal distribution with mean and variance equal 
to the mean and variance specified for the binomial distribu 
tion of the number promoted at time t. 
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Similarly , 



Q i (t)v i (t) + /QTItTv^Tt) [1 - vT (t) ] W i L (t) 

- N(Q i (t)v i (t) ,Q i (t)v i (t) [1 - v..(t) ] ) 

is a normally distributed random variable with mean and 
variance equal to the mean and variance specified for the 
binomial distribution of the number attrited at time t. 

For each interval of time (t,t+l] we can define the 
change in rank i, i.e., Q^(t+1) - Q^(t), as a combination 
of normally distributed random variables. 



Q i (t+1) - Q i (t) = 



u i-1 Q i _ 1 (t) + /uT_^ (t) [1 - u i _ 1 (t) ]Q i _ 1 (t) W i _ 1 (t) 



(promotions into rank Q^) 



u i (t)Q i (t) - Ai^t) [1 - u ± {t) ]Q i (t) W^(t) 



(promotions out of rank Q^) 



v i (t)Q i (t) - / V;L (t) [1 - vTit) ]Q i (t) W i iJ (t) 



(attritions out of rank Q^) 



From this relationship, Q^(t+1) can be solved for in terms 
of Q^(t). Hence, we assume for i > 1, 
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Q i (t+1) = u i _ 1 (t)Q i _ 1 (t) + /u i _ 1 (t) [1 - u~7 (t) IQ^! (t) W i _ 1 P (t) 

- /u i (t) [1 - u^t) ]Q i (t) W i P (t) 

- /v.(t) [1 - v.(t) ]Q i (t) W ± L (t) 

+ [1 - u ± (t) - v ± (t ) ] Q ± (t) (IH.l) 

where (W. P (t), i = 0,l,...,r-l} and (W. L (t), i = l,...,r} 

X X 

are independent random variables, having a normal distribution 
with mean zero and variance equal to one. In addition all 
the W random variables are independent of (Q^(t), i = l,...,r}. 
Let 



x i (t) 



Q i (t) - Q o q i (t) 



(III .2) 



If Q q is sufficiently large, then X(t) = [X^ (t) ,X^ (t) , . . . ,X r (t) ] 
should have approximately a multivariate normal distribution 
with mean zero. 

From equation (III. 2) we have 



Q i (t) = Q 0 q i (t) + X i (t) 1 = lr '"' r ( XII - 3 > 

In Appendix B we replace the variables Q^(t) in equation 
(III.l) by the expression in (III. 3) and then take the limit 
as Q q + ». This procedure yields recursive equations for 
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r}. The 



{q^(t),i = l,...,r} and {X^(t),i = 1,..., 

(q^(t),i = l,...,r} are constants and (X^(t),i = l,...,r} 
is a multivariate normal random variable with mean zero. 

Hence in light of (III. 3), Q(t) will also have a multivariate 
normal distribution, at least in the limit as Q q ^ ®. In 
the next chapter we will present a recursive scheme to 
evaluate q^(t) , Var[X^(t)] and cov [X^ (t) ,Xj (t) ] . 
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IV. THE RECURSIVE SCHEME 



Only results will be presented in this section. Deriva- 
tions of the results will be presented in Appendix B of this 
paper . 

The following are definitions required for the recursions 
which follow: 



Var [X^ ( t) ] = rtu ( t) 

Cov [X. ( t) , X . ( t) ] i m. . (t) 

1 J 1 / J 

RESULT 1: A RECURSIVE SCHEME FOR COMPUTING q^t), t = 1,2,... 

i = 1: q^t+1) = a ( t) + [1 - ^ (t) - v 1 (t) ] q 1 (t) 

i > 1: q i (t+l) = u i _ 1 (t) q i _ 1 (t) + [l-u^(t) - (t) ] q^ (t) 

RESULT 2: A RECURSIVE SCHEME FOR COMPUTING VartX^t)], t = 1,2,. 

i = 1: m^t+l) = [1 - ^(t) - v L (t) ] 2 m 1 (t) 

+ a (t ) [1 - a(t) ] 

+ {u x (t) [1 - u 1 (t) ] + v 1 (t) [1 - v 1 (t) ] Iq-^t) 
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